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Abstract 

We conjecture a combinatorial formula for the monomial expansion of the image of any 
Schur function under the Bergeron-Garsia nabla operator. The formula involves nested 
labelled Dyck paths weighted by area and a suitable "diagonal inversion" statistic. Our 
model includes as special cases many previous conjectures connecting the nabla operator 
to quantum lattice paths. The combinatorics of the inverse Kostka matrix leads to an 
elementary proof of our proposed formula when q — 1. We also outline a possible approach 
for proving all the extant nabla conjectures that reduces everything to the construction of 
sign-reversing involutions on explicit collections of signed, weighted objects. 

1 Introduction 

The nabla operator introduced by Francois Bergeron and Adriano Garsia [2] plays a fundamental 
role in the theory of symmetric functions and Macdonald polynomials. To define this operator, 
let us first introduce some notation. We let A denote the ring of symmetric functions in the 
variables xi,X2,--- with coefficients in the field Q{q,t). The vector space A has many well- 
known bases, all indexed by integer partitions. We will use the following bases of A in this 
paper: the monomial symmetric functions m^; the homogeneous symmetric functions /i^; the 
elementary symmetric functions e^; the power-sum symmetric functions p^; the Schur functions 
s^; and the modified Macdonald polynomials H^. More details may be found in the encyclopedic 
reference |26| . 

The nabla operator is the unique Q(g, t)-linear map on A such that V(^^) = 
for all partitions fi, where n(/i) = X]i>i(^ ~ f^' transpose of n. Thus, the modified 

Macdonald polynomials are the eigenfunctions of the nabla operator. Prom the combinatorial 
point of view, the nabla operator is important because it encodes a wealth of information about 
q, t-analogues of combinatorial objects such as lattice paths, parking functions, and labelled 
forests. The connection to combinatorics arises by considering the matrix of the linear operator 
V relative to various bases for A. Given any two bases (6a) and (c^) of A and any linear operator 
T on A, we write {c^)[T](bx) denote the unique matrix of scalars o^^a ^ QiQ^t) such that 
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Algebraic Object 


Combinatorial Model 


Conjectured by: 


Proved by: 


(V(e„),si-) 


q, i-Dyck paths 


Haglund 12j (cf. [10 ) 


Garsia,Haglund 


(V(e„),/Ji") 


q, i-parking functions 


Haglund,Loehr [14^20] 


open 


(V(e„), Cdhn-d) 


q, t-Schroder paths 


Egge, Haglund, 
Kremer,Killpatrick 7^^ 


Haglund 13J 


(V"(e„),si-.) (m > 1) 


TO-Dyck paths 


Lochr [U 


open 


(V"'(e„),/ii,.) (to > 1) 


labelled m-Dyck paths 


Loehr,Remmel 


open 


(V"'(e„),/i^) (to> 1) 


labelled TO-Dyck paths 


Haglund , Haiman,Loehr , 
RemmeljUlyanov [T7I 


open 


(V(p„),si.) 


q, i-square paths 


Loehr, Warrington [25 


Can, Loehr [5] 


(V(p„),/i^) 


labelled square paths 


Loehr, Warrington [25 


open 


(Vg=i(sA/^),.V) 


digraphs 


Lenart 19J 


Lenart [19] 




fillings of J-{ijl) 


Haglund llj 


Haglund , Hainian, 
Loehr [HllTe] 



Table 1: Summary of research on the combinatorics of the nabla operator. 



for all partitions A. In particular, if T = V and (c^) is the dual basis for relative to the Hall 
inner product on A, it follows that 

= (V(6a),c;). 

We often restrict consideration to the subspace A"- of symmetric functions of degree n, so that 
the matrix in question is a finite square matrix with rows and columns indexed by the partitions 
of n. 

By definition, ) is a diagonal matrix with diagonal entries = q^(^^')t"'^^\ For 

other choices of the input and output bases, one obtains other Q{q, t)-matrices representing the 
nabla operator. Remarkably, the entries in these matrices are often polynomials in q and t with 
integer coefficients all of like sign; i.e., we often have a^^A € t]. Whenever this occurs, 

one can seek combinatorial interpretations for various entries a^^\ as sums of suitable signed, 
weighted objects. Such interpretations have been sought after, conjectured, and (in some cases) 
proved by many different authors. Table [T] gives a list (not necessarily exhaustive) of some recent 
research efforts in this area. 

Each of the conjectures mentioned in Table [1] gives only partial information about the nabla 
operator. For example, the Garsia-Haglund q, t-Catalan Theorem establishes a combinato- 
rial interpretation for just one of the coefficients in the matrix (sp)[V](s^), namely as^„^s^„ = 
(V(e„),sin). The main conjecture in [17] extends this result to a combinatorial interpretation 
for the monomial expansion of V(e„), but this still only yields information about one column 
of the matrix )[V](s;\)- Om goal in this paper is to present a new conjecture that gives a 
combinatorial interpretation for every entry in the matrix {m ,)[^](sx)- shall see that this 
conjecture unifies and clarifies the partial conjectures mentioned in Table [TJ 

In Section[2]of this paper, we describe our conjectured combinatorial model for the monomial 
expansion of V(sa) and explain some connections to the more specialized conjectures in Tabled) 
In Section [3l we give a proof of our conjecture when q = 1; the proof relies heavily on the 
combinatorics of the inverse Kostka matrix = )[id](^^). In Section [H we outline a 

combinatorial approach that, if implemented, would prove the full conjecture. The proof method 
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suggested in this final section, which reUes heavily on the recently discovered combinatorial 
interpretation for modified Macdonald polynomials, reduces all the extant nabla conjectures 
to the problem of defining sign-reversing involutions on certain explicit collections of signed, 
weighted objects. 

2 The Combinatorial Model 

This section presents our conjectured formula for the monomial expansion of V(sa)- To prepare 
for this formula, we must first review the known combinatorial interpretation for (V(en),sin) 
and the conjectured interpretation for the monomial expansion of V(e„). 

2.1 Quantum Dyck Paths 

Fix a positive integer n. A Dyck sequence of length n is a list g = {go,gi , • • • , gn-i) of nonnegative 
integers such that 50 = and ^j+i < + 1 for alH < n — 1. The area of a Dyck sequence is 
area(5() = '^27=0 9i- ^ diagonal inversion of a Dyck sequence is a pair of indices i < j such that 
idi ~ 9j) £ {0) !}• We let dmv(g) be the number of diagonal inversions of g. Given any logical 
statement P, let x{P) = 1 if P is true, and x{P) = if P is false. Then we can write 

dinv(5) = Yl - 9j e {0, 1}). 

0<i<j<n 

For example, g = (0, 0, 1, 2, 0, 1, 1, 2, 3, 1) is a Dyck sequence of length 10 with area(5f) = 11 and 
dmv{g) = 15. 

Dyck sequences correspond naturally to Dyck paths, which are lattice paths from (0, 0) to 
(n, n) consisting of n unit north steps and n unit east steps that never go below the line y = x. 
We convert a Dyck sequence to a Dyck path by drawing gi complete lattice squares to the left 
of the line y = x in the i'th row from the bottom, and following the north and west boundary 
of these squares to obtain a lattice path. Then area{g) is the number of squares between the 
path and the line y = x. The statistic dmv(g) counts pairs of cells lying immediately right of 
north steps in the path, such that the cells are either on the same diagonal, or such that the 
lower square lies one diagonal to the left of the upper square. The diagonal inversion statistic 
was proposed by Haiman in connection with the Garsia-Haiman q, t-Catalan numbers. Haglund 
had previously defined another statistic on Dyck paths, called the bounce score [12j. Garsia and 
Haglund proved that 

(V(e„),Sin)= iarea{g)^dmv(9) ^ ^ ^bounce « ^arcaW ^ 

g&DS„ TT&DPn 

where DSn is the set of Dyck sequences of order n, and DP^ is the set of Dyck paths of order 
n UM- 

In [17], the previous combinatorial formula was extended to a conjectured formula for the 
monomial expansion of V(e„). To describe this extension, we consider pairs {g,r), where g 
is a Dyck sequence of length n and r = (ro,ri, . . . is a list of n positive integers such 

that gi+i = gi + 1 implies < rj+i. Let LDPn be the set of all such pairs. We visualize an 
object {g, r) G LDPn by drawing the Dyck path vr associated to g and labelling the n north 
steps of vr (from bottom to top) with the labels tq, ri, . . . , r„_i. The only restriction on the 
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labels is that the labels in each column must strictly increase reading upwards. Now, define 
area(5,r) = Ya=o 9i ~ area(5), and define 

dinv(g, r) = ^ xiOi - 9j = and < rj) + ^ xidi - 9j = and > rj). 

i<j i<j 

Haglund, Haiman, Loehr, Remmel, and Ulyanov [17j conjectured that 

n-l 

V(e„)= n^'-^' (1) 

{g,T)£LDP„ i=0 

and they proved that this expression is symmetric in the Xj's. Because of this symmetry, the 
"HHLRU conjecture" is equivalent to the following assertion: for all ^ = (pi, H2, ■ ■ ■) \~ n, the 
in, (l"))-entry of (m^)[V](,^) is the sum of tarea(g,r)^dmv(g,r) ^^^^ objects {g,r) G LDPn such 
that the r- vector contains /ij copies of i for all i. 

2.2 Combinatorial Model for (V(sA),Sin) 

We are going to conjecture a formula for the monomial expansion of V(sa). Before doing so, 
we describe a related conjecture for the "sign character" (V(sA),sin), where A is an arbitrary 
partition of n. The sign character conjecture involves nested quantum Dyck paths, while the full 
conjecture involves nested quantum labelled Dyck paths. 
Our conjecture for the sign character has the form 

(V(sA),sin)=sgn(A) (2) 

GeNDPx 

where sgn(A) G {+1, — l}i NDP\ is a certain collection of nested Dyck paths constructed from 
A, and area, dinv : NDPx N are suitable weight functions. We will define the quantities 
sgn(A), NDP\, area and dinv in the context of a specific example. 

Suppose n = 14 and A = (5,3,2,2,2). We begin by drawing the Ferrers diagram of the 
transposed partition A' = (5, 5, 2, 1, 1). Next, we fill this diagram with "rim hooks" by repeatedly 
removing the entire northeast border of A', as shown in Figure [H For < i < Ai = ^(A'), let Ui 
be the length of the hook that starts in the i'th row from the top of the diagram; let rii be zero 
if there is no such hook. In our example, we have 

(no,ni,n2,n3,n4) = (9,0,0,5,0). 

Define the spin of A' to be the total number of times a border hook crosses a horizontal boundary 
of a unit square in the Ferrers diagram of A', and define the sign sgn(A) = (— 1)*^p'°('^ ). In our 
example, sgn(A) = (—1)^ = —1. We also define the dinv adjustment by setting 

Ai-l 

adj(A) = ^ (Ai - 1 - i)xim > 0). 

i=0 

This adjustment is the sum of the row indices in which the nonzero border hooks start, if we 
number the rows 0, 1, . . . reading from bottom to top. In our example, adj(A) = 1 + 4 = 5. 
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Figure 1: Dissection of A' into border strips. 



Figure 2: Example of nested Dyck paths. 



Next, we describe the coUection of objects NDP\. Let / = Ai = ^(A'). We consider /-tuples 
of lattice paths 11 = (ttq, tti, . . . , vr^-i) such that VTj is a lattice path from (i, i) to {i + ni,i + rii) 
consisting of rii unit north steps and rii unit east steps that never go strictly below the line 
y = X. If nj = for some i, then tTj is a degenerate path consisting of a single vertex at 
We say that 11 is nested iff for all i j, no edge or vertex of vTj coincides with any edge or 
vertex of ttj. By definition, NDPx consists of all such /-tuples of nested Dyck paths. Note that 
degenerate paths are important for determining nesting. Figure [2] shows a typical element of 

^-0-^(5,3,2,2,2)- 

We can represent 11 = (vro, vri, . . . , 7r/_i) G NDPx by a "Dyck configuration," which is 
the analogue of a Dyck sequence in this setting. A Dyck configuration is an /-tuple of words 
G = {g^'^\g^^\ ■ ■ ■ iff*-'"^-*), where 5^*) is the Dyck sequence for the Dyck path vTj. We choose the 
indexing of the letters in these Dyck sequences to match the alignment of paths in the picture. 

(i) 

More precisely, for i < a < i + rii, let Qa he the number of complete lattice squares in the region 
bounded below by y = a, bounded above by y = a -|- 1, bounded on the right hy y = x, and 
bounded on the left by TTj; for all other values of a, Qa is undefined. For example, the Dyck 
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configuration for the nested paths in Figure [2] is: 



/ 5(0) :011233455\ 



G= 5^^): 



5(3) : . . .01011. 
V5(^): 

Here, dots indicate positions where ga is undefined. 

It is convenient to identify nested Dyck paths with the associated Dyck configurations. 
Given a partition A = (Ai, A2, . . . , A^) with associated border hooks of lengths ni, 712, . . . , n/, an 
/-tuple G = {ga'^) belongs to NDPx iff the following requirements are satisfied: (i) for every i, 
{ga^ : i < a < i + rii) \s a, Dyck sequence of length n^; (ii) if = 0, then g^*^ > for a\\ i < k 
such that g^^^ is defined; (iii) if > and i < k, then g^^^ > g^^^ for all j such that both sides 

are defined; and (iv) if > and i < k, then g^^^ > g^j^li + 1 for all j such that both sides 
are defined. Conditions (iii) and (iv) express the nesting requirement for two nontrivial paths 
in terms of the Dyck sequences; condition (ii) expresses the nesting requirement when the inner 
path has length zero. 

Given G € NDP\, the area of G is the sum of the areas of the Dyck paths comprising G: 



j 

i=0 i<j<i+ni 



area(G) = ^ 9 



Note that lattice squares in the picture that appear inside multiple Dyck paths are counted 
multiple times in the area statistic. Next, the diagonal inversion statistic for G is 



dinv(G) = adj(A) + ^ x(ffi"^ - 9^^ = l)x(a < h) 

a,b,u,v 

A, 

a,b,u,v 



^^at^ - 9b^ = < ^) or (a = 5 and u < v)). 



(u) (v) 

In these sums, we consider all possible choices of a, b, u, v such that ga and 5^ are both defined. 
For the example shown in Figure [2l we have area(G) = 27 and dinv(G) = 28. 
Our conjectured formula 

(V(5a), Sin) = sgn(A) Yl t'^'-'^'^^^^g'^'"^^^) 

GeNDPx 

has been verified by computer for all partitions A of all integers n < 9. 



2.3 Combinatorial Model for the Monomial Expansion of V(sa) 

Roughly speaking, our main conjecture for V(sa) is obtained by "adding labels" to the sign 
character formula introduced in the previous subsection. This is done in the spirit of the shuffle 
conjecture for V(e„) of [IT]. For any partition A, we associate a collection of labelled nested 
Dyck paths which we abbreviate LNDPx- Note that "nested" in this case will be a slightly 
weaker notion than that used in the definition of NDP\. 
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Let / = Ai = ^(A'). An element of LNDP\ consists of a pair {G,R). Here, G is an /-tuple 



(^(0),^(l) 



,g^^ ^)) where each g^^^ encodes the Dyck sequence of some path ttj of length 



no 



among the entries {gj'\ gj^_li, ■ ■ ■ , gj^^nj-i)- "^^^ /-tuple R = [A^\A^\ 



is a list of 



labels. For all j, the length of r^-'^ equals the length of g^^^ (i-e., r^-'^ = {rj''\rj'^^, . 
and G (Z>o)"^. Together, G and R are subject to the following conditions: 



' 'j+nj 



-l)) 



1 Ifo^^'^ 



1, then rp^ < rf:^\. 



2. The value (7) is undefined or greater than zero for all j < i < / — 1. 

(7) (k) (i) (k) 

3. For all a and all j < k, either one of ga or gl^_i is undefined, or ga > 9a~i- 

(j) (k) (j) (k) (j) (k) 

4. For all a and all j < k, if ga and (7a-i defined with ga = Qa-i + 1? then Va < ^a-i- 

The first condition states that every path VTj is matched up with a label vector that strictly 
increases up the columns of the path. The remaining conditions imply that no path encounters 
the start of any other (even zero-length) path; that the paths are weakly nested with no shared 
east steps; and that for a given column, no larger label in the row directly above belongs to a 
lower-indexed path. 

Given {G,R) € LNDPx, the area of {G,R) is (as before) the sum of the areas of the Dyck 
paths comprising G: 

area(G) = £ gf 

i=0 i<j<i+ni 

The diagonal inversion statistic for (G, R) simply incorporates the labels into the two summa- 
tions: 

dinv(G,i2) = adj(A) + x(5i"^ - of^ = l)x(r^^ > r^^)x{a < h) 



u,v,a,b 



(v) 

9 b 



0)x(^i"'' < ^i^'')x{0' < b or {a = b and u < v)). 



u,v,a,b 



(3) 

(u) (v) 

In these sums, we consider all possible choices of o, b, u, v such that ga and 5^ are both defined. 
Set xr = Y\ua^ (")• example shown in Figure El we compute the coefficient of m2,i,i in 

V(s2,2) as —t^q^{2 + t + q). (Note that in this example, adj(A) = 1.) 
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Figure 3: Computation of the coefficient of ?t^2,i,i in V(s2,2)- 



In Figure m we illustrate the pair {G,R) where 

7(0) ■ 1 2 3 3 3 4 3> 



G 



'9' 
9 
\9 



(1) 

(2) 
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. 



2 3 2 
2 . . 
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Conjecture 1. For any partition A, 

V(sa) = Sgn(A) Yl t^^MG,R)qdin^iG,R)^^^ (5^ 

iG,R)€LNDPx 

Theorem 2. Our conjectured formula for V(sa) (i.e., the right side of ©j, is a symmetric 
function of the xj 's. 

Proof. We prove this by expressing our summation in question as a weighted hnear combination 
of the Lascoux-Leclerc-Thibon (LLT) polynomials (introduced in [18J), which are known to be 
symmetric. 

The LLT polynomials can be defined combinatorially as follows. Let F be a /c-tuple of skew 
shapes (X^/u^, X^/u"^, . . . , /u^) with n total boxes. For each such F, we write SSYT^ to denote 
the set of /c-tuples of semistandard Young tableaux T = (Ti, T2, . . . , T^) such that for each i, 

1. Ti has shape X^/i^^. 

2. Ti has entries from {xi,X2, . . . ,X]\f}. 

We denote the content of T by xt = YiiTlcGxyui ^T,(c)- Given some T S SSYT^, we define a 
diagonal inversion statistic as follows. For a cell c = we define the diagonal of c to be 

diag(c) = j — i. Then set 



dinv(T) = ^ [x(diag((i) - diag(c) = 1 and T{c) < T{d)) 

csTk^deTi (6) 
+ x(diag(c) - diag(£i) = and T{c) > T{d))]. 
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The LLT polynomials are defined as 



LLTr ixi,X2, ■ ■ . ,XAr) 



E 



dinv(T) 



XT- 



TeSSYTf 



It is proved in [151 IH] that each LLT^ (xi,X2, • • • ,xn) is a symmetric polynomial in the Xj's. 
By taking inverse limits in the usual manner, we obtain symmetric polynomials LLTr G A". 

We now explore the relationship between elements of LNDP\ and the LLT polynomials. We 
describe the correspondence via an example. Consider the pair (G, R) illustrated in Figure [H 
Reading up the columns from right to left, we encounter five contiguous multisets of north steps 
of varying lengths. The configuration G will thereby be associated with a tuple of skew shapes 
T{G) = (AVi^\ AV^^^ • • • , X^/y'') of sizes 2, 8, 2, 1 and 4, respectively. The third through fifth 
groups, each consisting of north steps from a single path, will yield skew shapes that are columns 
of the appropriate heights. In particular, we get the shapes (1^), (l'^)/(l^) and (1*^), respectively. 
We have augmented as necessary each A* and i^* in equal amounts to ensure that any north step 
in G going north from the line y = x + b maps to a cell in T{G) with diagonal equal to b. When 
we have more than one path contributing to a given multiset of north steps, we proceed in an 
analogous manner. However, in this case, the cells arising from the j-th path from the left are 
additionally shifted to the right and up by j — 1 units. (Notice that this is a diagonal-preserving 
shift.) Doing so yields X^/u^ = {2*)/{2^) and X'^/u^ = (3^) / {3"^ , I) . 

The labels in R accompany their respective north steps to give us the element T G SSYTp'' 
illustrated in Figure [5j Note that we have aligned the skew shapes along the diagonals to 
facilitate computation of dinv. 
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15 
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0'^ 
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/ 

14 


16 
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13 


/ 

/ 
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7 


9 



4 12 



17 



Figure 5: T corresponding to (G, R) of Figure [H 



The above correspondence gives a well-defined correspondence from a Dyck configuration 
G to a tuple of shapes r(G). The correspondence can be modified to become invertible by 
the following two adjustments (which we do not make). First, send all north steps in a given 
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column to a (possibly disconnected) skew shape. Second, include empty skew shapes for columns 
without any north steps. In any case, by including labels, the correspondence between Dyck 
configurations and tuples of shapes extends to a map from elements (G, R) € LNDPx to tuples 
of filled shapes T{G,R). As is discussed below, these filled shapes are precisely the tuples T 
appearing in LLTp^fj) . 

Our first claim is that the shapes are, in fact, skew shapes. This follows from Conditions [2] 
and [3] in the definition of LNDPx ■ Our second claim is that the fillings of the skew shapes are 
semistandard. That the entries increase up columns is the content of Condition [T] while rows are 
forced to weakly increase by Condition SI Furthermore, it is easily checked that any element T 
contributing to LLTr(G) appears as the image of {G, R) for some labelling R. It follows that 

XR= XT- (7) 

R: {G,R)£LNDPx TGSSYTr(G) 

We now consider the relationship between dmv{G, R) and dinv(r(G, i?)). Fix {G,R) € 
LNDPx corresponding to a T{G,R) G SSYTr(G)- Suppose we have u,v,a and b such that 

fl'i"^ — glj'^ = 1 and > rj^^^ . Under our correspondence, and g^^'^ will correspond to cells 

c and d (labelled ri"^ and r[^\ respectively) in T{G, R) = (Ti, T2, . . . , T^). We may write c ^ Ti 

(u) (v) 

and d € Tj for some Since a < b but ga > g^ , we must have i > j- Since diagonals are 
preserved, we see that c and d will contribute to the first summand in ([6]). A similar analysis of 
terms with a < 6 in the second summation of ([3|) will yield the second summand of ([6]). 

We are left to consider those quadruples a,b,u,v for which a = b and u < v. Such a 
quadruple will contribute to ([3|) exactly when ri"'' < rj^'^. However, the corresponding pair of 
cells in T{G,R) will never contribute to dinv(T(G, i?)) because they will lie in the same skew 
shape. Fortunately, for (G, R) G LNDPx a-nd such a quadruple, we will always have ri"^ < r^^ : 
To see this, note that by Conditions [2] and El g^^l^ is defined. By Condition HJ ri"^ < r^^li- 
Finally, r'^li < by Condition [TJ For brevity, write 

k 

5{V{G))=YK>^'/^') 

i=l 

where we define 5 for a skew shape by 

{i,j)&X/v a>0 

Then 

dinv(G,i?) = adj(A) + dinv(T(G, i?)) + n(r(G)). (8) 
Combining ^ and ([8]), we conclude 

^ ^dmv(G,i?)^^ ^ ^adj(A)+n(r(G)) ^ ^dmv(T(G,fl))^^^ (^g) 

R: {G,R)&LNDPx TGSSYTr(G) 

Of course, the summation on the right side of ([9]) is LLTp^^j) . So, if we allow G to vary as well 
and sum over all such G, we get 

^ ^area{G,fl)^dmv(G,fl)^^ ^ ^^area{G)^adj(A)+n(r(G))LLrp^^^^^ (--^Q^) 

(G,R)&LNDPx G 
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Since, as mentioned, each LLTp(-(^) is a symmetric function in the Xj's, it follows that the left 
side of ([To]) is as well. □ 



2.4 Hook Shapes 

Let A = (a, for some a > 1; so A' = (n - a + 1, 1""^). When we fill the Ferrers diagram of 

A' with rim hooks as described in Section [2.2] we find that there is only one nonzero rim hook. 
Thus, (no, ni, . . . , Ua-i) = (n, 0, . . . , 0), so sgn(A) = (—1)"^^ and adj(A) = a — 1. Furthermore, 
objects in LNDP\ can be identified with those elements {g, r) of LDP^ for which gi > for 
< i < a. So when A is a hook, we obtain the following simplifications of the main conjecture. 

Conjecture 3. 

gi>0 for 0<i<a 

(g,r)eLDPr,: 
gi>0 for 0<i<a 



2.5 Trapezoidal Paths 

Conjecture [1] neatly explains some of the formulas conjectured in |22tl23j regarding lattice paths 
in trapezoids. Consider the trapezoid bounded by the vertices {0,k), {0,k + n), {k,k) and 
{k + n,k + n) for some k, n with A: > and n > 1. A trapezoidal lattice path of type (n, k) is a 
path from (0, k) to {k + n,k + n) consisting of n north steps and k + n east steps (all of length 
one) such that no vertex of the path lies strictly below the line y = x. The case of A; = is that 
of Dyck paths. Write T^^k for the set of trapezoidal lattice paths of type (n, k). 

Given a path P G 7^,^, define the sequence g{P) = {go,gi, ■ ■ ■ , <7n-i) by taking gi to be the 
number of unit squares in the strip bounded below hy y = k + i, above by y = A; + i + 1, on the 
left by P, and on the right hy y = x. Define area(P) = Y17=o 9i ^^'^ 

n—l 

dinv(P) = Y X{9i - 9j e {0, 1}) + max(A; - gt, 0). 

i<j i=0 

It is conjectured in [22l[23] that Eper„ ^ is symmetric in q and t. 

We now show that this conjecture follows from Conjecture [H To this end, for n,k >0 and 
n + k > 0, define 



A(re, k) 



k + l 



The partition A(n, k) has been defined so that when the special rim hooks are placed in A(n, k)' , 
the hooks are of lengths no = k + n and Ui = k — 2i for 1 < i < [A;/2j. Since the successive 
length differences are only 2 and the shortest path is of length or 1, this forces the path of 
length Tii for z > to consist of north steps followed by rij east steps. The outermost path, 
of length k + n has the single restriction that it must begin with k north steps. It follows that 
the elements G G NDPx(^n k) ™- natural bijection with the g{P) for P £ Tnk hy sending 

G = (5W,5«, . . . ,5(L'^/^J)) to = (^f • • • '^Sn-i)- 
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To complete the proof, we need only examine how area(G) compares to aTea{g') and how 
dinv(G) compares to dmv{g'). It is a simple computation to show that 



lk/2] 



area(G) = area(5f') + 



k-2i 



As for the diagonal inversion statistic, first note that by throwing away all but the outermost 
path, we have lost adj(A(n, /c)) = ( L'^/^^"'"^^ . We have also lost the contributions to dinv(G) arising 

from interactions between any two of the paths. However, we gain X^^^^*""^ max(A: — gf^^ , 0) . We 
leave it to the reader to show, in fact, that these collectively give the appropriate difference. 



11 

4 
2 





Figure 6: Example of correspondence with trapezoidal paths. 



We illustrate an example in Figure [6] for k = 6 and n = 5. On the left is shown A(5, 6)' along 
with its special rim hooks of lengths 11, 4, 2 and 0. On the right we show a typical element 
of NDPx(^5fi) ■ Notice that by considering the portion of the outermost path weakly above the 
dotted line, we have an element of T^fi. For this example, 

01234542012\ 

.0123 

..01 

/ 

So area(G) = 31, dinv(G) = 45 and area{g') = 9. We now check that dinv(G) — dmv{g') is 
indeed 22 = 31 — 9. In going from G to g' , we lose the adjustment adj(A(5, 6)) = 6. We also 
lose all of the interactions between g^^^ and g^^^ for i = 1, 2, 3 that contribute to dinv(G). These 
account for a loss of 37 more. However, we gain the sum Yli=o^^^(.^ ~ 9v^) ~ ^l- This gives 
us a difference of 22 as desired. 

2.6 Higher Powers of Nabla 

Following |17j . there is a natural conjecture to make regarding a combinatorial framework for 
V™'(sa) for m > 1. To start, define an m-Dyck path of length n to be a lattice path with n 
north steps and mn east steps that never go below the line my = x. These reduce to Dyck paths 
when m = 1. An m-Dyck sequence, 9{P) = (90,91, ■ ■ ■ i9n-i), is defined by setting gi to be the 



G 



I 9' ' 

gi2) 
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number of unit squares lying between the lines y = i and y = i + 1, to the right of P, and to the 
left of my = x. An n-tuple of nonnegative integers is an m-Dyck sequence for an m-Dyck path 
if and only if go = and gi < gi-i + m for all 1 < i < n. 

For any given A, we define a set LNDP^ in a manner entirely analogous to how we defined 
LNDPx- The primary difference is that for a pair (G, i?) G LNDP^, G is an m-Dyck configu- 
ration; i.e., each element of G is an m-Dyck sequence. While area(G, R) is defined by summing 
the entries in G as usual, we generalize the definition of dinv(G, R) as follows: 

m—l 

dinv(G) = adj(A) + ^(^^"^ " dl"^ + ^ = "^)^(''^"^ > ^ ^) 

u,v,a,b d=0 

m—l 

+ E Y.^(^ ^ 9^a^ - Sb'^ +d <m)xia <b) 

u,v,a,b d=0 
m—l 

+ E E ^(^^"^ - ai"^ +d = 0)x(ri") < ri''^)x{a < b or {a = b ^nd u < v)). 

u,v,a,b d=0 

(11) 

Conjecture 4. For any partition A anc? m > 1, 

V"^(sa) = Sgn(A) J]] ^area(G,iJ)^dinv{G,i?)^^_ (;L2) 

{G,R)eLAfDP™ 

We illustrate a typical element of LNDP^^^^ in Figure [3 As an exercise, the reader can 
explicitly write down the elements of LNDP^^ 2) labelled with three I's and a 2 to compute that 

(V2(s2,2), /i3,l) = -{tqf{l +t + t^ + q + qt + q^). 




We remark that trapezoidal lattice paths and m-Dyck paths can be treated at the same time 
by replacing the line y = x with my = x in the definition of trapezoidal paths. Of course, the 
dinv statistic needs to be adjusted accordingly. See ||22i i23j for details. 

3 Proof when q = l 

In this section, we will prove the following specialization of the main conjectures. 
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Theorem 5. For all partitions X, 

(V(sA),sin)|,=i = sgn(A) Yl (13) 

GeNDP^ 

Visx)U=i = sgn(A) t'''''^''^XR. (14) 

{G,R)&LNDPx 

We remark that Lenart [19] proved a closely related result that establishes the Schur positiv- 
ity of \7q=i{sx/,y) by expanding the latter polynomials in terms of skew Schur functions. Lenart's 
proof relies heavily on Jacobi-Trudi determinantal formulas. We adopt a more combinatorial 
approach that makes heavy use of the inverse Kostka matrix. One benefit of the present method 
is that the combinatorial significance of the global sign sgn(A) is more readily apparent. 

3.1 Specialized Nabla Operator 

The first step is to replace nabla by a more convenient operator. Let H^\q=i denote the image 
of under the specialization sending q to 1; these specialized Macdonald polynomials form 
a basis for the Q(t)-vector space Aq(^) of symmetric functions with coefficients in Q(t). Define 
Vg=i to be the unique Q(t)-linear map such that Vg=i(^^|g=i) = t"'^^^H^\q=i for all partitions 
fi. It is known that Vg=i is a ring homomorphism (this follows easily from the combinatorial 
interpretation of given in f|4]). Furthermore, it can be shown that 

V(sA)|g=l = Vg=i(sA). 

Henceforth we will study the ring homomorphism Vg=i. 

3.2 Elementary Symmetric Function Expansions 

The second step is to study the matrix (ep)[Vg=i](e^). Given a Dyck path vr, let a(7r) = 
(ai(7r), a2(vr), . . .) be the lengths of the vertical columns formed by consecutive north steps 
of vr. Garsia and Haiman proved that 

V,=i(e„)= Y (15) 

(see Theorem 1.2 in [10]). Keeping in mind the combinatorial interpretation of Ck = in terms 
of semistandard tableaux, it is clear that this formula is equivalent to ([1]) when q = 1. Since the 
ring homomorphism Vg=i preserves multiplication, we immediately deduce from (jlSh that 

V,=i(e.)= Yl ^^'^''^^'^IIm-O' (16) 

{■m,TT2,...)eDP^ i 

where DP^ is the set of all lists of paths (7ri,7r2, . . .) such that tTj is a Dyck path of order fj. 
Furthermore, since (e^, si^) = 1 for all ^ h n, we also deduce that 

(V,=i(e,),sin) = Y t^'^""^"^^ {y^n). (17) 

(7ri,7r2,...)GDP^ 
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3.3 Transition Matrices 



The third step is to multiply by suitable transition matrices to change the input and output 
bases in the matrix (g^) [V(j=i](ep)- The relevant transition matrix turns out to be the inverse 
Kostka matrix, which we now review. (For more background on transition matrices, see Section 
1.6 of [26j or the references [H [6].) Recall that the Kostka number K\^^ is the number of 
semistandard tableaux of shape A and content /x. We have the identities 

s\ = Kx,^,m^ (18) 

= J^i^A.^SA (19) 
A 

A 

Letting K = {Kx ^j) be the matrix of Kostka numbers, these identities assert that = 
{m^)M{s^)\ K = (,^)[id](ft^); and K = (,^,) [id](e^). Now, let K'^ = {K'^^) be the inverse of 
the matrix K. The previous identities now read 

"^/^ = E^M^^ (21) 

A 

= (23) 

Remmel and Egecioglu discovered the following important combinatorial interpretation for the 
entries K~\^ of the inverse Kostka matrix |i6j. A special rim hook tabloid of shape A and type ^ 
is a filling of the Ferrers diagram J-{\) with rim hooks of length /ij that all start in the leftmost 
column. For example. Figure [1] displays one special rim hook tabloid of shape A' = (5, 5, 2, 1, 1) 
and type (9, 5). A rim hook spanning r rows has sign ( — l)*""^. The sign of a rim hook tabloid 
is the product of the signs of all the rim hooks in the tabloid. Let SRHT(/u, A) be the set of all 
special rim hook tabloids of shape A and type Remmel and Egecioglu showed that 

K',^ = E «g^(^)- 

TgSRHT{/i,A) 

For example, we see from Figure [8] that -^'^4^3 1) (3 2 2 1) ~ ~'~3- ^^^^ ^le convenient to introduce 
a modified notion of the "type" of a special rim hook tabloid. Given a rim hook tabloid T, 
let ai{T) be the length of the rim hook that starts i rows from the top of the diagram for T 
(for i = 0,1,...). If no rim hook starts in row i, we let ai{T) = 0. The ordered sequence 
a(T) = (Qo(r), ai(T), . . .) will be called the total type of T. By dropping zero entries in a{T) 
and arranging into decreasing order, we obtain the type of T (which is a partition). The total 
type of the tabloid in Figure [1] is (9,0,0,5,0). 
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Figure 8: Special rim hook tabloids. 



3.4 Intersecting Path Model 

Combining (j23|) with (jl6|) . we immediately obtain a combinatorial interpretation for the entries 
in the matrix {efj,)[^g=i]{sx)- Using linearity of Vq=i, we calculate 

M {■Ki)<^DP^, i 

Here is an explicit combinatorial interpretation of the right side. Given A h n, we consider all 
pairs (T, H) where T is a special rim hook tabloid of shape A' and 11 = (vTj : i > 0) is a sequence 
of labelled Dyck paths such that vTj has order aj(T) for < i < Ai = ^(A'). The sign of such 
a pair is sgn(r); the t-weight of the pair is area(n) = ^jarea(7rj); and the monomial weight is 
obtained as usual from the labels of vrj. The sum of all such signed, weighted objects gives us 
Vq=i{s\) G Q(t)[rEi, j;2, • • •]• Using the fact that (e^,sii) = 1 for all ^, we obtain an analogous 
combinatorial interpretation for the quantity (Vg=i(sA), Sin). The only difference is that 11 now 
consists of unlabelled Dyck paths. 

For example, Figure [U] depicts a typical object contributing to (Vg=i(s(6^5^4^2,i,i,i))) Siao). The 
sign of this object is (-1)'^ = -1, and the t-weight is 33 + + 2 + + 4 + = 39. As in ^ it is 
convenient to display the paths in 11 by letting tTj start at and end at (i + aj(T), i + aj(T)). 

3.5 Cancellation for Unlabelled Paths 

To complete the proof of the theorem, we define sign-reversing involutions that cancel objects 
of opposite sign, and then show that the fixed points are enumerated by the formulas (|13|) and 
(jl4p . For ease of exposition, we consider the unlabelled case first. So far, we have shown that 

(V,=i(sA),.in) = sgn(T)t-'-^-(n)^ (24) 
(T,n) 

where T is any special rim hook tabloid of shape A', and IT = (vTj : < i < Ai) is a collection of 
unlabelled Dyck paths such that tTj has order aj(T) for all i. 

We can cancel pairs of objects with the same t-weight and opposite signs as follows. Suppose 
that (T, n) is an object such that there exist two paths in 11 that intersect at some vertex, yiore 
precisely, there exist i < j and such that tTj and tTj both reach (x,y). Among all such 

choices of i, j, a;, y, choose the one such that x, then y, then i, then j is minimized. Write tTj = /37 
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and TTj = Se, where /3 is a path from (i, i) to (x, y), 7 is a path from (x, y) to (i + aj(T), i + Q!i(T)), 
5 is a path from to (x,y), and e is a path from {x,y) to (j + aj{T),j + aj(T)). Replace 
TTj by l3e and tTj by ^7 to get a new Hst of paths IT' with the same earhest intersection and the 
same total i- weight. Next, consider the special rim hook tabloid T. It is easy to see that there 
is a unique way to "switch the tails" of the special rim hooks starting in rows i and j so that the 
new special rim hooks in these rows have lengths j + Oij{T) — i and i + ai(T) — j, respectively. 
Furthermore, the sign of the new tabloid T' is opposite to the sign of T. Figure [10] displays the 
object that is matched to the object in Figure [9] by this process. It is clear from the description 
that the map (T, 11) 1— > (T', 11') is an involution. 

What do the fixed points of the involution look like? Clearly, (T, 11) is a fixed point iff no 
two Dyck paths in 11 intersect. Because of the way the starting points of the Dyck paths are 
arranged along the line y = x, this can only occur if the lengths of the nontrivial Dyck paths 
in the list (7ri,7r2, . . .) form a strictly decreasing sequence. In other words, the lengths of the 
nonzero rim hooks in T must strictly decrease reading from top to bottom. One sees easily 
that this condition forces T to consist of a succession of "border hooks" as described earlier in 
connection with sgn(A). Indeed, we now see that sgn(A) is simply the sign of the unique special 
rim hook tabloid T that occurs in the objects that are fixed points. Taking the cancellation and 
fixed points into account, we see that the desired result (jl3p follows from (j24p . 

3.6 Cancellation for Labelled Paths 

We sketch the cancellation for labelled paths while focusing on the differences with respect to 
the unlabelled case. In general, paths can be rerouted at intersections as in the unlabelled 
case. In particular, any two paths that intersect at the beginning of a common east step can 
be cancelled with an object of equal i-weight and opposite sign. Similarly, if we have an object 
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where one path intersects the beginning of another (possibly zero-length) path, we can cancel 
with an object of equal t-weight and opposite sign. The label of each step should be envisioned 
to remain with the individual step rather than with a particular path. 

We are left to consider the scenario that two paths intersect as in Figure [TTJl or 2 (z is 
allowed to be one in either case). We claim that each object containing an intersection of type 1 
can be paired with an object containing a region of type 2. 



1) 



z-1 



C2 
ci 



I 



z 

z-1 



d2 
do 



2) 



z-1 



C2 



d'. 



z-1 



Id2 
cjjid'i 

Id'o 



Figure 11: Cancehation for labelled paths along north steps. 



Assume we have an intersection such as that of Figure [TTJl. Set 

C = {z} U {1 < i < z : a > rfj-i} and D = {1} U {1 < i < z : di > Cj_i}. 

Suppose that j € C (1 D; choose the smallest such j. Then we can set d[ = di for < i < j, 
= Cj for 1 < i < j, d[ = Ci iov j < i < z and c[ = di for j < i < z. This yields a paired 
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object as in Figure [TTJ2 with the same q- and t-weights, but with opposite sign. This process is 
invertible. So it only remains to show that C H D 7^ 0. 

Assume in fact that C r\ D = 0. Hence 1 C and z ^ D. Let j be as smah as possible 
such that j £ C (such a j must exist since z £ C). It is immediate that j > 1 and j — 1 ^ C. 
Therefore, Cj_i < dj-2 < dj-i < dj. From this we conclude that j € D. This is a contradiction. 
So, as desired, C n £> 7^ 0. 

The above argument shows that all configurations with an intersection such as in Figure [TTJl 
cancel with an equal-weight object of the opposite sign. It remains to characterize the configu- 
rations that do not cancel. We have just seen that they must be weakly nested. That is, while 
any two paths are allowed to share some north steps, the path that started earlier can never 
pass under a path that started later. In fact, the fixed points are described by Conditions [H [21 [3] 
along with 

(7) (k) (j) (k) 

4 . For all a and j < k, ga and g\_i are defined with ga = ga-i + Ij then either 

(a) r^J^ < r^^\, or 

(b) g^a^ is not defined, or 

(c) g\^li is not defined, or 



(d) g^a^ and ^^-i ^'^^ both defined with r^'^ < r^"'^ 



a-i- 

We now show that any fixed point (which must satisfy Condition 4'), must actually satisfy 
Condition S] as well. So suppose on the contrary we have a fixed point such as in Figure \TT\ 2 

(i) (k) (k) (j) 

with a and j < k for which > r^_i- It is easy to check that having ga or g^li not being 
defined would contradict the fact that we have a fixed point. So assume they are, in fact, both 

(k) (j) 

defined. The only possibility is that < r^li- But then we give a similar argument to the 
one above to obtain a contradiction. 



4 Proof Strategy for the Full Conjecture 

Most of the known facts about combinatorial interpretations of the nabla operator (cf. Tabled]) 
were proved via long, laborious algebraic manipulations making heavy use of the machinery of 
plethystic calculus [3l [H [U [9l [13] . In the past, one barrier to finding purely combinatorial proofs 
has been the absence of combinatorial conjectures that fully characterize the action of the nabla 
operator. Of course, this barrier is overcome by the conjecture in ^ Another obstacle to a 
combinatorial analysis of nabla was the lack of combinatorial information about the Macdonald 
polynomials, which appear in the definition of nabla. However, recent breakthroughs by Haglund 
et al. im [T5] [T6] have resolved this difficulty as well. We review Haglund's combinatorial 
description of Macdonald polynomials in the next subsection. Combining this material with 
more inverse Kostka combinatorics, we then show how to reduce the proof of conjecture ([5]) to 
the problem of finding sign-reversing involutions on certain explicit collections of objects. If this 
proof strategy can be completed, it would yield a fully combinatorial proof of all the conjectured 
facts about the nabla operator. 
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4.1 Combinatorial Macdonald Polynomials 

Let /X be a fixed integer partition. A Haglund filling of ;U is a function T : — > Informally, 
T is a labelling of the cells in the diagram of /u with arbitrary positive integers. The content 
monomial of T is 

Recall that the major index of a word w = W1W2 ■ ■ ■ is the sum of the positions of the descents 
of w, i.e., m.ai{w) = Yli=i '^xi'^i > ^^i+i)- We define maj(T) to be the sum of the major indices 
of the words obtained by reading the labels from top to bottom in each column of T. 

Next, we define the notion of an inversion triple. Consider three cells c,d,e G ^(/i) such 
that c and e are in the same row (with c to the left of e), and d is the cell immediately below c. 
We call (c, d, e) an inversion triple for T iff 

T(c) < T{d) < T{e) or Tid) < T{e) < T{c) or T(e) < T(c) < T{d). 

By convention, if c is to the left of e in the bottom row of J^{fJ-), we regard (c, e) as an inversion 
triple iff T(c) > T{e). Finally, let inv(r) be the total number of inversion triples in T. 
Haglund [IT] discovered the formula 

This formula was proved by Haglund, Haiman, and Loehr [151ll6j. This formula essentially gives 
the transition matrix (^^-j [id](-^^^. More precisely, writing xx = Yl^^i xf\ we have 

H^ = Y^A{X,f,)mx where A{X,fi) = ^ gmv(T)^maj(T)_ (25) 

xt=xx 

Note that the Q{q, t)-valued coefficient matrix A = (^a,/^) is invertible, since the modified 
Macdonald polynomials form a basis of A. It follows that the m^'s are the unique vectors vx 
solving the system of equations = ^(-^' Now, apply nabla to both sides of (125]) . 
We obtain 

r^F^ = j;A(A,M)(V(mA)). (26) 

A 

Reasoning just as before, it follows that the vectors V{mx) constitute the unique solution to the 
system of equations 

A 

Extracting the coefficient of m-jy on both sides, we see that a given indexed family of vectors (vx) 
is equal to the indexed family (V{mx)) iff 

T^A{i>,fj.) = A{\, fj,){vx\m^) for all partitions fi,!^. (27) 
A 
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4.2 Combinatorial Formulation of the Problem 

To proceed, we need to have a combinatorial interpretation of the quantities V(m;^). One such 
interpretation follows immediately from our conjecture for V{sx) by using the inverse Kostka 
matrix again. More precisely, note that linearity of nabla gives 

V{mx) = Y^K-^^S/isp) 

p 

P TeSRHT(A,p) {G,R)eLNDPp 

Extracting the coefficient of rrii,, this formula says that the ly, A-entry of the matrix {m„)[^]{rnx) 
is 

Yl E sgn(r)sgn(p)t^'^'=^(^'-^)g<i'^^(^'^). 

P TeSRHT(A,p) {G,R)eLNDPp:xR=x^ 

Computer calculations indicate that every entry of (mj)[V]{m^) is a polynomial in q and t with 
coefficients all of like sign. Yet the formula just written is a sum of both positive and negative 
objects. This indicates that there should be a sign-reversing, weight-preserving involution on 
the objects just described whose fixed points all have the same sign. If such an involution could 
be found, we would have a better description of the entries of the matrix under consideration. 

By the remark at the end of the last subsection, we see that all the combinatorial formulas 
for nabla will be proved if the following "master identities" can be verified for all partitions u: 

T,A{u, /z) = ^ A{X, E E E sgn(p)t--(^'^)g^--(^'«). 

A P rGSRHT(A,p) {G,R)&LNDP(p):xR=x^ 

(28) 

Recalling the combinatorial interpretation for the entries of A, we can reformulate the 
master identities as follows. Fix i/ h n. On one hand, let X be the set of all tuples 
z = ([/, A, T, p, (G, R)) such that: 

(i) A and p are partitions of n; 

(ii) [/ is a Haglund filling of shape /u and content A; 

(iii) T is a special rim hook tabloid of shape p and content A; 

(iv) {G,R) € LNDPp has content xr = x^- 

The sign of z is sgn(r) sgn{p) G {+1, —1}; the t-weight of z is maj(C/) + area(n); the q-weight 
of z is inv([/) + dinv(n). 

On the other hand, let X' be the set of all Haglund fillings U' of shape fj, and content x^. 
The sign of U' is always positive; the t-weight is n{p) + maj([/'); the g-weight is n(/x') + inv(C/'). 
The master identity (|28p holds for p and v iff there exists a sign-reversing, weight-preserving 
involution on X with positive fixed points, and a weight-preserving bijection between these fixed 
points and X' . 

As a closing remark, we recast the preceding discussion in terms of matrices. We are es- 
sentially trying to prove a matrix identity of the form TA = ALB, where T is the diagonal 
matrix of scalars T^, ^ is the matrix describing the monomial expansion of modified Macdonald 
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polynomials, L is the inverse Kostka matrix, and B is the matrix conjectured to give the mono- 
mial expansion of V(sa). Now, ALB = A{LB) = (AL)B. The matrix LB gives the monomial 
expansion of V{mx), as discussed above, while the matrix AL gives the Schur expansion of mod- 
ified Macdonald polynomials. Using special rim hook tabloids, we can write down collections 
of signed, weighted objects to interpret either of the matrix products LB or AL. In each case, 
computer evidence (and the known Schur-positivity of Macdonald polynomials) tells us that we 
should be able to cancel objects in these collections to obtain smaller collections of objects all of 
like sign. Finding an interpretation for the entries of AL that involves only positive objects is a 
well-known open problem. It is likely that this problem (or the analogoTis problem for LB) will 
need to be solved first before further progress can be made in understanding the triple product 
ALB. 
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